Display device and controlling method of display device

ABSTRACT

A display device and a method capable of rotating a display based on a type of a user command are provided. The display device according to the disclosure receives a user command while first content is displayed on the display, the display being configured to operate in a first orientation while displaying the first content, maintains the display to operate in the first orientation when the received user command is a command to control a feature corresponding to the first content, determines, based on a type of a second content, to control the display to operate in the first orientation or a second orientation different from the first orientation when the received user command is a command to display the second content on the display, and controls the motor to rotate the display based on the determined first orientation or the second orientation.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation of U.S. application Ser. No.16/587,531 filed Sep. 30, 2019, based on and claims priority under 35U.S.C. 119 to Korean Patent Application No. 10-2019-0062772, filed onMay 28, 2019, in the Korean Intellectual Property Office, which is basedon and claims priority from U.S. Provisional Patent Application No.62/839,058, filed on Apr. 26, 2019, in the U.S. Patent and TrademarkOffice, the disclosures of which are herein incorporated by reference intheir entireties.

BACKGROUND Field

Apparatuses and methods consistent with the disclosure relate to adisplay device and a controlling method of a display device, and moreparticularly, to a display device capable of determining an orientationof a display based on a type of a user command for controlling thedisplay device, and a controlling method of a display device.

Description of the Related Art

In recent years, users' desire to experience content through mobiledevices, such as smart phones, is increasing. Therefore, web content,including social media content, is provided to match a screen ratio ofthe mobile device and an orientation (or a direction) in which the userholds the mobile device. In addition, even in the case of video content,which has generally been provided having a horizontal orientation, theamount of the content provided having a vertical orientation hasrecently increased rapidly.

However, when the user watches the content through the mobile devicesuch as the smartphone, a watching experience of the user is limitedcompared to the case where the user watches the content through adisplay device such as a TV due to the limitation of a display size ofthe mobile device.

On the other hand, the display device such as the TV generally has adisplay which is long in the horizontal direction, and is generallyinsufficient to watch content having a vertical orientation. Inaddition, even in the case in which the display device includes adisplay capable of being rotated such that the display is long in thevertical direction, it is actually pointed out that the rotation of thedisplay does not correspond to a watching experience of the user forvarious contents.

Therefore, there is a need for a display device capable of rotating adisplay to meet the watching experience of the user for various contentswhile providing various contents in a larger visual experience than themobile device.

SUMMARY OF THE INVENTION

Embodiments of the disclosure overcome the above disadvantages and otherdisadvantages not described above. Also, the disclosure is not requiredto overcome the disadvantages described above, and an embodiment of thedisclosure may not overcome any of the problems described above.

The disclosure provides a display device capable of determining arotation direction of a display based on a type of a user command forcontrolling the display device, and a controlling method of a displaydevice.

According to an aspect of the disclosure, there is provided a displaydevice comprising: a display; a motor configured to rotate the display;a memory configured to store at least one instruction; and a processorconfigured to execute the at least one instruction to: receive a usercommand while first content is displayed on the display, the displaybeing configured to operate in a first orientation while displaying thefirst content; when the received user command is a command to control afeature corresponding to the first content, maintain the display tooperate in the first orientation; when the received user command is acommand to display the second content on the display, determine, basedon a type of a second content, to control the display to operate in thefirst orientation or a second orientation different from the firstorientation; and control the motor to rotate the display based on thedetermined first orientation or the second orientation.

The display device may further comprise: a communicator comprising acircuit, wherein the processor is further configured to receive throughthe communicator, the user command from at least one of a user terminalconnected to communicate with the display device or a remote controldevice for controlling the display device.

The processor may be further configured to determine the secondorientation of the display as a landscape orientation based on the usercommand for displaying the second content being received from the remotecontrol device while the first content is displayed on the display.

The processor may be further configured to: receive information on thesecond content and a third orientation of the user terminal from theuser terminal through the communicator when the user command fordisplaying the second content on the display is received from the userterminal while the first content is displayed on the display, andcontrol the motor to operate the display in the first orientation or thesecond orientation based on the information on the third orientation ofthe user terminal, wherein the second content corresponds to contentdisplayed on a screen of the user terminal.

The processor may be further configured to: determine the secondorientation of the display as a portrait orientation based on thereceived information indicating that the third orientation of the userterminal is the portrait orientation, receive the second contentcorresponding to the content displayed on the screen of the userterminal being rotated in the landscape orientation, control the motorto rotate the display into the determined portrait orientation, rotatethe received second content into the portrait orientation, and controlthe display to display the rotated second content on the display in theportrait orientation.

The processor may be further configured to determine the secondorientation of the display as the landscape orientation based on acommunication connection with the user terminal being terminated whilethe second content is displayed on the display.

The processor may be further configured to: obtain a first user commandcorresponding to a first user speech input received while the firstcontent is displayed on the display, the first user command beingobtained by inputting the received first user speech input into a firstartificial intelligence model, when the obtained first user command isthe received user command to control the first content, maintain thefirst orientation of the display, and when the obtained first usercommand is the received user command to display the second content onthe display, determine, based on the type of a second content, tocontrol the display to operate in the first orientation or the secondorientation.

The processor may be further configured to: determine the secondorientation of the display as a portrait orientation based on the secondcontent including a search result for a plurality of contentscorresponding to the first user command, control the motor to rotate thedisplay in the determined portrait orientation, display the secondcontent on the display rotated in the portrait orientation, obtain asecond user command corresponding to a second user speech input receivedwhile the second content is displayed on the display rotated in theportrait orientation, the second user command being obtained byinputting the received second user speech input into the firstartificial intelligence model, and determine a fourth orientation of thedisplay as a landscape orientation based on the obtained second usercommand being a command to display one image content of the plurality ofcontents displayed according to the first user command on the display.

The processor may be further configured to: obtain information on thefirst orientation or the second orientation of the display correspondingto the type of the second content by inputting information on the typeof the second content to a second artificial intelligence model, anddetermine the first orientation or the second orientation of the displaybased on the obtained information on the first orientation or the secondorientation.

According to another aspect of the disclosure, there is provided acontrolling method of a display device, the controlling methodcomprising: receiving a user command while first content is displayed ona display of the display device, the display being configured to operatein a first orientation while displaying the first content; when thereceived user command is a command to control a feature corresponding tothe first content, maintain the display to operate in the firstorientation, and when the received user command is a command to displaythe second content on the display, determining, based on a type of asecond content, to control the display to operate in the firstorientation or a second orientation different from the firstorientation; and controlling the display to be rotated the determinedfirst orientation or the second orientation.

The receiving of the user command may comprise receiving the usercommand from at least one of a user terminal connected to communicatewith the display device or a remote control device for controlling thedisplay device.

The determining of the second orientation of the display may comprisedetermining the second orientation of the display as a landscapeorientation based on the user command for displaying the second contentis received from the remote control device while the first content isdisplayed on the display.

The controlling method may further comprise: receiving information onthe second content and a third orientation of the user terminal from theuser terminal when the user command for displaying the second content onthe display is received from the user terminal while the first contentis displayed on the display; and controlling the motor to operate thedisplay in the first orientation or the second orientation based on theinformation on the third orientation of the user terminal, wherein thesecond content corresponds to content displayed on a screen of the userterminal.

The determining of the second orientation of the display may comprisedetermining the second orientation of the display as a portraitorientation based on the received information indicating that the thirdorientation of the user terminal is the portrait orientation andreceiving the second content corresponding to the content displayed onthe screen of the user terminal being rotated in the landscapeorientation, and the controlling of the display may comprise:controlling the display to be rotated in the determined portraitorientation, and displaying the received second content in the portraitorientation on the display rotated in the portrait orientation.

The second orientation of the display may be determined as the landscapeorientation based on a communication connection with the user terminalbeing terminated while the second content is displayed on the display.

The receiving of the user command may comprise obtaining a first usercommand corresponding to a first user speech input received while thefirst content is displayed on the display, the first user command beingobtained by inputting the received first user speech input into a firstartificial intelligence model, and when the obtained first user commandis the received user command to control the first content, maintain thefirst orientation of the display, and when the obtained first usercommand is the received user command to display the second content onthe display, determine, based on the type of a second content, tocontrol the display to operate in the first orientation or the secondorientation.

The determining of the second orientation of the display may comprisedetermining the second orientation of the display as a portraitorientation based on the second content including a search result for aplurality of contents corresponding to the first user command, thecontrolling of the display may include: controlling a motor to rotatethe display in the determined portrait orientation, and displaying thesecond content on the display rotated in the portrait orientation, andthe controlling method further comprises: obtaining a second usercommand corresponding to a second user speech input received while thesecond content is displayed on the display rotated in the portraitorientation, the second user command being obtained by inputting thereceived second user speech input into the first artificial intelligencemodel, and determining a fourth orientation of the display as alandscape orientation based on the obtained second user command being acommand to display one image content of the plurality of contents on thedisplay.

The determining of the rotation direction of the display may comprise:obtaining information on the first orientation or the second orientationof the display corresponding to the type of the second content byinputting information on the type of the second content to a secondartificial intelligence model, and determining the first orientation orthe second orientation of the display based on the obtained informationon the first orientation or the second orientation.

According to another aspect of the disclosure, there is provided acomputer readable recording medium including a program for executing acontrolling method of a user terminal comprising: performing acommunication connection with a display device based on receiving a usercommand for transmitting content corresponding to a screen beingdisplayed on a display of the user terminal; obtaining rotated contentin which the screen being displayed on the display is rotated in alandscape orientation based on information indicating that anorientation of the user terminal is a portrait orientation; andtransmitting the information indicating that the orientation n of theuser terminal is the portrait orientation and the obtained rotatedcontent to the display device connected to the user terminal.

According to another aspect of the disclosure, there is provided adisplay device comprising: a memory configured to store at least oneinstruction; and a processor configured to execute the at least oneinstruction to: receive a user command for controlling content displayedon a display of the display device; determine a type of user commandbased on analyzing the user command; control the display to be arrangedin a first orientation based on the user command being a first type ofuser command; and control the display to be arranged in a secondorientation based on the user command being a second type of usercommand.

The processor may be further configured to control the display to bemaintained in the first orientation when the received user command is tocontrol a feature of the content while the content is displayed on thedisplay.

The processor may be further configured to control the display to bearranged in the first orientation or the second orientation bycontrolling a motor to physically rotate the display.

The first type of user command may be a command received from a remotecontroller, and wherein the second type of user command is a commandreceived from a portable user terminal.

The second orientation may correspond to an orientation of a screen ofthe portable user terminal.

The first type of user command may comprise an instruction to provide alist of items to be displayed by the display, and wherein the secondtype of user command is an instruction to select one item from the listof items.

The first orientation may be a landscape orientation and the secondorientation may be a portrait orientation.

According to another aspect of the disclosure, there is provided adisplay device comprising: a memory configured to store at least oneinstruction; and a processor configured to execute the at least oneinstruction to: receive first information indicating that a portableuser terminal is displaying first content on a display of the portableuser terminal in a portrait orientation; receive second contentcorresponding to the first content, the second content corresponding thefirst content being rotated into a landscape orientation; and generate athird content by rotating the received second content into a portraitorientation; and display the third content on a display of the displaydevice.

According to another aspect of the disclosure, there is provided adisplay device comprising: a memory configured to store at least oneinstruction; and a processor configured to execute the at least oneinstruction to: receive a user command while first content is displayedon a display, determine, based on the received user command being acommand to control a feature corresponding to the first content, anorientation of the display to be same as an orientation of the displayprior to receiving the user command, determine the orientation of thedisplay based on a type of a second content based on the received usercommand being a command to display the second content on the display,and control a motor to rotate the display based on the determinedorientation of the display.

BRIEF DESCRIPTION OF THE DRAWING FIGURES

The above and/or other aspects of the disclosure will be more apparentby describing certain embodiments of the present disclosure withreference to the accompanying drawings, in which:

FIG. 1 is a diagram schematically illustrating a process of controllinga display device according to an embodiment of the disclosure.

FIG. 2 is a block diagram illustrating a configuration of a displaydevice according to an embodiment of the disclosure.

FIG. 3 is a block diagram illustrating in detail the configuration ofthe display device according to an embodiment of the disclosure.

FIGS. 4 and 5 are diagrams illustrating in detail a process ofcontrolling the display device according to an embodiment of thedisclosure based on a user command according to a user speech.

FIG. 6 is a block diagram illustrating a configuration of a userterminal according to an embodiment of the disclosure.

FIG. 7 is a diagram illustrating in detail a process of controlling thedisplay device according to an embodiment of the disclosure based oninformation on a rotation direction of the user terminal.

FIGS. 8A and 8B are diagrams illustrating a user interface of the userterminal according to an embodiment of the disclosure.

FIGS. 8C and 8D are diagrams illustrating a process of enlarging orreducing content displayed on the display device through the userterminal and displaying the enlarged or reduced content.

FIG. 9 is a diagram illustrating a remote control device according to anembodiment of the disclosure.

FIG. 10 is a diagram illustrating a user interface of the display deviceaccording to an embodiment of the disclosure.

FIG. 11 is a flowchart illustrating a control method of a display deviceaccording to an embodiment of the disclosure.

FIG. 12 is a diagram illustrating in detail a speech recognition processaccording to an embodiment of the disclosure.

FIG. 13 is a block diagram illustrating a detailed configuration of aprocessor according to an embodiment of the disclosure.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS

One or more embodiments of the disclosure will be illustrated in thedrawings and described in detail in the detailed description. However,it is to be understood that it is not intended to limit the scope to theone or more embodiments, but includes various modifications,equivalents, and/or alternatives according to the embodiments of thedisclosure. For instance, one or more embodiments of the disclosure maybe variously modified. Throughout the accompanying drawings, similarcomponents will be denoted by similar reference numerals.

In describing the disclosure, when it is decided that a detaileddescription for the known functions or configurations related to thedisclosure may unnecessarily obscure the gist of the disclosure, thedetailed description thereof will be omitted.

In addition, the following embodiments may be modified to severaldifferent forms, and the scope and spirit of the disclosure are notlimited to the following embodiments. Rather, these embodiments make thedisclosure thorough and complete, and are provided in order tocompletely transfer the technical spirit of the disclosure to thoseskilled in the art.

Terms used in the disclosure are used only to describe specificembodiments and are not intended to be limiting of the scope. Singularforms are intended to include plural forms unless the context clearlyindicates otherwise.

In the disclosure, an expression “have”, “may have”, “include”, “mayinclude”, or the like, indicates an existence of a corresponding feature(for example, a numerical value, a function, an operation, a componentsuch as a part, or the like), and does not exclude an existence of anadditional feature.

In the disclosure, an expression “A or B”, “at least one of A and/or B”,“one or more of A and/or B”, or the like, may include all possiblecombinations of items listed together. For example, “A or B”, “at leastone of A and B”, or “at least one of A or B” may indicate all of (1) acase in which at least one A is included, (2) a case in which at leastone B is included, or (3) a case in which both of at least one A and atleast one B are included.

Expressions “first”, “second”, and the like, used in the disclosure mayindicate various components regardless of a sequence and/or importanceof the components, will be used only in order to distinguish onecomponent from the other components, and do not limit the correspondingcomponents.

When it is mentioned that any component (for example, a first component)is (operatively or communicatively) coupled with/to or is connected toanother component (for example, a second component), it is to beunderstood that any component is directly coupled with/to anothercomponent or may be coupled with/to another component through the othercomponent (for example, a third component).

According to one or more embodiments, when it is mentioned that anycomponent (for example, a first component) is “directly coupled with/to”or “directly connected to” to another component (for example, a secondcomponent), it is to be understood that the other component (forexample, a third component) is not present between any component andanother component.

An expression “configured (or set) to” used in the disclosure may bereplaced by an expression “suitable for”, “having the capacity to”,“designed to”, “adapted to”, “made to”, or “capable of” depending on asituation. A term “configured (or set) to” may not necessarily mean only“specifically designed to” in hardware.

Instead, an expression “an apparatus configured to” may mean that theapparatus is “capable of” together with other apparatuses or components.For example, a “processor configured (or set) to perform A, B, and C”may mean a dedicated processor (for example, an embedded processor) forperforming the corresponding operations or a generic-purpose processor(for example, a central processing unit (CPU) or an applicationprocessor) that may perform the corresponding operations by executingone or more software programs stored in a memory device.

In embodiments, a ‘module’ or a ‘portion’ may perform at least onefunction or operation, and be implemented by hardware or software or beimplemented by a combination of hardware and software. In addition, aplurality of ‘modules’ or a plurality of ‘portions’ may be integrated inat least one module and be implemented as at least one processor exceptfor a ‘module’ or a ‘portion’ that needs to be implemented by specifichardware.

According to one or more embodiments, various elements and regions inthe drawings are schematically illustrated. Therefore, the technicalspirit of the disclosure is not limited by relatively sizes or intervalsillustrated in the accompanying drawings.

Hereinafter, embodiments of the disclosure will be described in detailwith reference to the accompanying drawings so that those skilled in theart to which the disclosure pertains may easily practice the disclosure.

FIG. 1 is a diagram schematically illustrating a process of controllinga display device 100 according to an embodiment of the disclosure.

As illustrated in FIG. 1, a display device 100 according to anembodiment of the disclosure may rotate a display of the display device100. That is, the display device 100 according to the disclosure mayperform a so-called pivot function. Specifically, the display may berotated to be in a state in which the display is positioned or orientedin a landscape direction or a portrait direction. As illustrated FIG. 1,the display may be positioned in the portrait direction as depicted bysolid lines (110-1) or in the landscape direction as depicted by dotlines (110-2). Furthermore, FIG. 1 illustrates that the display rotatesin a counterclockwise direction (A1). However, the display may alsorotate in a clockwise direction according to another embodiment.

Here, the state in which the display is positioned in the landscapedirection refers to a state in which the display is positioned in theform in which a horizontal length of the display is longer than avertical length of the display, and may be referred to as a so-calledlandscape orientation state. On the other hand, the state in which thedisplay is positioned in the portrait direction refers to a state inwhich the display is positioned in the form in which the vertical lengthof the display is longer than the horizontal length of the display, andmay be referred to as a so-called portrait orientation state.

Hereinafter, in describing the disclosure, a case in which the displayis pivoted to be in in the landscape orientation or the portraitorientation is expressed as the display being rotated in the landscapedirection or the portrait direction. According to an embodiment, thedisplay device 100 may be implemented as, for example, a digital TV or amonitor, but the type of the display device 100 is not particularlylimited.

According to an embodiment of the disclosure, the display device 100receives a user command for controlling the display device 100.Specifically, the display device 100 may receive the user commandthrough a user terminal 200 connected to communicate with the displaydevice 100, and may also receive the user command through a remotecontrol device 300 for controlling the display device 100.

Here, the user terminal 200 may communicate with the display device 100,and transmit a control signal and an image content to the display device100. The user terminal 200 may communicate with the display device 100through methods such as Wi-Fi, Bluetooth, and the like, but thecommunication method is not limited to a particular method. The userterminal 200 may be implemented as, for example, a smartphone or atablet PC, but the type of the user terminal 200 is not particularlylimited.

In particular, the user terminal 200 may execute an application forcontrolling the display device 100 and display a user interface forreceiving a user interaction based on the executed application. Inaddition, when the user interaction is received through the userinterface, the user terminal 200 may transmit a control signalcorresponding to the received user interaction to the display device100. When the control signal is received from the user terminal 200, thedisplay device 100 may obtain a user command corresponding to thereceived control signal.

According to an embodiment, the remote control device 300 may receive auser input for controlling the display device 100, and output a controlsignal for controlling the display device 100 based on the received userinput. The remote control device 300 may output the control signal in acommunication method such as infrared communication, radio frequency(RF) communication, Bluetooth, or ultra-wideband (UWB), but thecommunication method of the remote control device 300 is not limited toa particular method. The remote control device 300 may be, for example,a remote controller, but is not limited thereto and may be implementedas a smartphone.

When the user command for controlling the display device 100 isreceived, the display device 100 may determine an orientation of thedisplay based on a type of the user command. Here, the determining theorientation of the display may include not only determining theorientation of the display as landscape orientation or as portraitorientation, but also determining that a current orientation of thedisplay is to be maintained. Hereinafter, one or more embodiments ofdetermining the rotation direction of the display based on the type ofuser command will be described in detail.

According to an embodiment, when the received user command is to controla first content being displayed on the display, the display device 100may determine that the current orientation of the display is to bemaintained. That is, when the received user command is for changing asetting related to the first content while maintaining the first contentbeing displayed on the display, the display device 100 may determine tomaintain the orientation of the display. That is, the orientation of thedisplay used for displaying the first content prior to receiving theuser command is maintained after receiving the user command. Forexample, when the received user command is to change a volume setting ofthe first content or to pause playback of the first content, the displaydevice 100 may maintain the orientation of the display.

According to an embodiment, when the received user command is to displaya second content on the display, the display device 100 may determinethe orientation of the display based on the type of the second content.That is, when the received user command is to display the second contentdifferent from the first content and without displaying the firstcontent previously displayed on the display, the display device 100 maydetermine the orientation of the display based on the type of the secondcontent.

Here, the determining of the orientation of the display based on thetype of the second content may be determined depending on whether it isappropriate to display the second content on the display rotated in thelandscape orientation or whether it is appropriate to display the secondcontent on the display rotated in the portrait orientation.

Specifically, the type of the second content may be determined dependingon whether the second content relates to broadcast content, to DVDcontent, to game content, to web page content, to e-book content, and tocontent corresponding to a screen being displayed on an external devicesuch as the user terminal 200.

For example, when the second content is the broadcast content, thedisplay device 100 may determine the orientation of the display as thelandscape orientation. Here, the broadcast content may include not onlycontent received from terrestrial channels, cable channels, andsatellite channels, but also content received from a server providing anonline streaming site. As another example, when the second content isthe web page content, the display device 100 may determine theorientation of the display as the portrait orientation when a serverprovides a web page in a mobile mode. According to an embodiment, thedisplay device 100 may determine the orientation of the display as theportrait orientation only when the server provides the web page in themobile mode.

According to an embodiment, the type of the second content may bedetermined based on various attributes such as an aspect ratio of thesecond content, a provider of the second content, and the like. Forexample, when the aspect ratio of the second content is less than 1,that is, when a landscape length of the second content is shorter than aportrait length, the display device 100 may determine the orientation ofthe display as the portrait orientation.

According to an embodiment, the second content is video content.According to another embodiment, the second content may also be speechcontent. That is, when a user command for outputting the second content,which is the speech content, while the first content is displayed on thedisplay, the display device 100 may maintain the orientation of thedisplay. That is, the display device 100 may maintain the orientationused to display the first content on the display even after the usercommand for outputting the second content is received.

According to an embodiment, the orientation of the display correspondingto the type of the second content may be pre-stored. According to anembodiment, the orientation of the display corresponding to the type ofthe second content may be pre-stored in the display device 100.According to an embodiment, the orientation of the display correspondingto the type of the second content may also be updated according to asetting of the user and stored.

In addition, the orientation of the display corresponding to the type ofthe second content may be obtained through a learned artificialintelligence model. Specifically, the display device 100 may obtaininformation on the orientation of the display corresponding to the typeof the second content by inputting information on the type of the secondcontent into the artificial intelligence model, and may also determinethe orientation of the display based on the obtained information on theorientation.

According to an embodiment, when a user command for displaying thesecond content is received from the remote control device 300 while thefirst content is displayed on the display, the display device 100 maydetermine the orientation of the display as the landscape orientation.For example, when a channel change command for displaying the secondcontent is received from the remote control device 300 while the firstcontent is displayed on the display in the portrait orientation, thedisplay device 100 may determine the orientation of the display fordisplaying the second content as the landscape orientation, rotate thedisplay in the landscape orientation direction, and display the secondcontent on the display in the landscape orientation.

According to an embodiment, when a user command for turning on thedisplay device is received from the remote control device 300 in a statein which the display device 100 is turned off, the display device 100may also determine the orientation of the display as the landscapeorientation.

According to an embodiment, the display device 100 may receive contentcorresponding to content being displayed on a screen of the userterminal 200 and display the received content on the display. That is,the display device 100 may perform a so-called mirroring process. Inaddition, when the display device 100 performs the mirroring process anddisplays the content corresponding to the content being displayed on thescreen of the user terminal 200 on the display, the display device 100may determine the orientation of the display of the display device 100based on information on an orientation of the user terminal 200.

According to an embodiment, when a user command for displaying thesecond content on the display is received while the first content isdisplayed on the display of the display device 100, the display device100 may receive the second content and information on the orientation ofthe user terminal 200 from the user terminal 200. According to anembodiment, when the second content is content corresponding to thecontent being displayed on the screen of the user terminal 200, thedisplay device 100 may determine the orientation of the display of thedisplay device 100 based on the information on the orientation of theuser terminal 200. For example, when the orientation of the userterminal 200 is the portrait orientation, the display device 100 maydetermine the orientation of the display of the display device 100 asthe portrait orientation, and when the orientation of the user terminal200 is the landscape orientation, the display device 100 may determinethe orientation of the display of the display device 100 as thelandscape orientation.

However, when the mirroring process as described above is performed, thecontent being displayed on the user terminal 200 is generallytransmitted to the display device 100 as a transmission image in thelandscape orientation. Therefore, even in the case in which theorientation of the user terminal 200 is the portrait orientation and theuser terminal 200 displays content in the portrait orientation, the userterminal 200 transmits the content corresponding to the contentdisplayed on the on the user terminal 200 to the display device 100 asthe transmission image by generating a landscape oriented image withoutrotating the content displayed in the portrait orientation asillustrated image 71 in FIG. 7. As such, a size of the content includedin the transmission image is reduced as compared to the case in whichthe content is transmitted as the transmission image in the portraitorientation. Furthermore, when the display device 100 enlarges the sizeof the content in a process of displaying the received transmissionimage on the display in the portrait orientation, deterioration of theimage included in the content may be caused.

Therefore, according to an embodiment of the disclosure, when theorientation of the user terminal 200 is the portrait orientation, theuser terminal 200 may transmit rotation content to the display device100, in which the content being displayed on the screen of the userterminal 200 is rotated into the landscape orientation, and the displaydevice 100 receives the rotated content in the landscape orientation andmay rotate the received content rotated into the portrait orientationagain and display the content rotated into the portrait direction on thedisplay in the portrait orientation.

Specifically, when information indicating that the orientation of theuser terminal 200 is the portrait orientation and the contentcorresponding to the content being displayed on the screen of the userterminal 200 is rotated in the landscape orientation are received fromthe user terminal 200, the display device 100 may determine the rotationorientation of the display as the portrait orientation. Thereafter, thedisplay device 100 may rotate the display to correspond to thedetermined portrait orientation, process the received content so thatthe received content is displayed in the portrait orientation on thedisplay, and display the processed content on the display.

According to an embodiment, when a communication connection with theuser terminal 200 is terminated while the mirroring process as describedabove is performed, the display device 100 may determine the orientationof the display as the landscape orientation. In this case, the displaydevice 100 may rotate the display in the landscape orientation tocorrespond to the determined landscape orientation, and may also displaycontent which is pre-stored in the display device 100 on the displayrotated in the landscape orientation.

As described above, when the orientation of the display corresponding tothe type of the user command is determined, the display device 100controls the display to correspond to the determined orientation. Here,the controlling of the display to correspond to the determinedorientation includes not only rotating the display to correspond to thedetermined orientation when the display is in a state that does notcorrespond to the determined orientation, but also not rotating (i.e.,maintaining) the display when the display is already in a statecorresponding to the determined orientation.

When the display is controlled to correspond to the determinedorientation, the display device 100 may display content corresponding toa user command on the display. Specifically, when the received usercommand is to control a first content while the first content isdisplayed on the display, the display device 100 may maintain the firstcontent displayed on the display. When the received user command is todisplay a second content while the first content is displayed on thedisplay, the display device 100 may display the second content on thedisplay. For example, when the display is rotated in the landscapeorientation according to the determined orientation, the display device100 may display the content corresponding to the user command on thedisplay rotated in the landscape orientation.

According to an embodiment, a user interaction for inputting the usercommand according to the disclosure may be input in various methods. Inparticular, the user command for controlling the display device 100 maybe input through a user speech. Hereinafter, an embodiment in which auser command corresponding to a received user speech is obtained byperforming speech recognition on the received user speech and anorientation of the display is determined based on the type of theobtained user command will be described in detail.

Specifically, the display device 100 may receive the user speech andobtain the user command corresponding to the received user speech byinputting the received user speech to a learned artificial intelligencemodel.

Here, the user speech may be input through the display device 100.However, the speech input may also be input through the user terminal200 connected to communicate with the display device 100 or the remotecontrol device 300 for controlling the display device 100. In addition,the speech recognition for the input user speech may be performedthrough an artificial intelligence model included in the display device100 or the user terminal 200 in an on-device manner, and may also beperformed through an artificial intelligence model included in a serverconnected to communicate with the display device 100 or the userterminal 200.

When the user command corresponding to the received user speech isobtained, the display device 100 may determine the orientation of thedisplay based on the type of the user command, as described above.

Specifically, when a first user speech is received while the firstcontent is displayed on the display, the display device 100 may obtain auser command corresponding to the received first user speech byinputting the received first user speech to a first artificialintelligence model. In addition, when the obtained user command is tocontrol the first content, the display device 100 may determine theorientation of the display as being maintained. According to anembodiment, when the obtained user command is to display the secondcontent on the display, the display device 100 may determine theorientation of the display based on the type of the second content.

For example, when the second content includes information on a pluralityof contents corresponding to a first user command, the display device100 may determine the orientation of the display as the portraitorientation. In addition, the display device 100 may rotate the displayto correspond to the determined portrait orientation and display thesecond content on the display rotated in the portrait orientation.

As another example, the display device 100 may receive a user speechsuch as “Please increase one channel” while the first content isdisplayed on the display, and obtain a user command related to a controloperation “display of content corresponding to broadcast channelassigned to No. 7” as the user command corresponding to the receiveduser speech. In this case, the user command corresponding to the userspeech is to display the second content on the display and the type ofthe second content is the broadcast content, and therefore, the displaydevice 100 may determine the orientation of the display as the landscapeorientation.

According to an embodiment, when a second user speech is received whilethe second content is displayed on the display rotated in the portraitorientation, the display device 100 may obtain a second user commandcorresponding to the received second user speech by inputting thereceived second user speech to the first artificial intelligence model.In addition, when the obtained second user command is to display oneimage content of the plurality of contents on the display, the displaydevice 100 may determine the orientation of the display as the landscapeorientation.

According to the one or more embodiments of the disclosure, the displaydevice 100 may provide various contents as a visual experience largerthan the user terminal 200 and may provide the content through thedisplay rotated to meet a watching experience of the user for variouscontents by rotating the display based on the type of the user commandfor controlling the display device 100.

One or more embodiments of the disclosure will be described in detailbelow with reference to FIGS. 2 to 13.

FIG. 2 is a block diagram illustrating a configuration of the displaydevice 100 according to an embodiment of the disclosure.

As illustrated in FIG. 2, the display device 100 according to anembodiment of the disclosure includes a display 110, a motor 120, amemory 130, and a processor 140.

The display 110 may output image data by a control of the processor 140.Specifically, the display 110 may output image which is pre-stored inthe memory 130 by the control of the processor 140. In particular, thedisplay 110 may also display a user interface stored in the memory 130.

The display 110 may be implemented as a liquid crystal display (LCD)panel, an organic light emitting diode (OLED) or the like, and may alsoimplemented as a flexible display 110, a transparent display 110, or thelike in some cases. However, the display 110 according to the disclosureis not limited to a particular kind.

In particular, in one or more embodiments according to the disclosure,the display device 100 may perform a so-called pivot function.Specifically, the display 110 may be rotated to be in a state in whichit is positioned in a landscape orientation or a portrait orientation.Hereinafter, in describing the disclosure, a case in which the display110 is pivoted to be in the state in which the display is positioned inthe landscape orientation or the portrait orientation is brieflyexpressed as the display being rotated in the landscape orientation orthe portrait orientation. According to an embodiment, the display 110may not only be manually rotated by the user, but may also beautomatically rotated by the processor 140 controlling the motor 120 forrotating the display 110.

According to an embodiment, the motor 120 rotates the display 110. Forinstance, the motor 120 may be connected to the display 110 and drivenby the processor 140 to rotate the display 110 connected to the motor120 in a clockwise or counterclockwise direction. Specifically, themotor 120 may be driven by a control signal from the processor to rotatethe display 110 to be positioned in a desired orientation. Accordingly,the display 110 may be rotated in the landscape orientation or theportrait orientation. The motor 120 may be implemented as various motorssuch as a direct current (DC) electric motor, an alternating current(AC) electric motor, a brushless DC (BLDC) electric motor, or anothertype of motor configured to rotate the display 110 of the display device100.

At least one command regarding the display device 100 may be stored inthe memory 130. In addition, the memory 130 may store an operatingsystem (O/S) for driving the display device 100. In addition, the memory130 may also store one or more software programs or applications foroperating the display device 100 according to one or more embodiments ofthe disclosure. For instance, the memory 130 may store various softwareprograms or applications for operating the display device 100 accordingto one or more embodiments of the disclosure. In addition, the memory130 may include a semiconductor memory such as a flash memory or thelike, or a magnetic storing medium such as a hard disk or the like.

Specifically, the memory 130 may include various software modules foroperating the display device 100 according to one or more embodiments ofthe disclosure, and the processor 140 may execute the various softwaremodules stored in the memory 130 to control an operation of the displaydevice 100. That is, the memory 130 is accessed by the processor 140,and readout, writing, correction, deletion, update, and the like of datain the memory 130 may be performed by the processor 140.

According to an embodiment of the disclosure, a term ‘memory’ may beused as a meaning including the memory 130, a read only memory (ROM) inthe processor 140, a random access memory (RAM), or a memory card (forexample, a micro secure digital (SD) card or a memory stick) mounted inthe display device 100.

In particular, in one or more embodiments according to the disclosure,the memory 130 may store the information on the rotation direction ofthe display 110 corresponding to the type of the content displayedaccording to the user command. In addition, the memory 130 may storecontent or the like received from an external device such as the userterminal 200 or a broadcast receiving device. In addition, variousinformation necessary within the scope for achieving the purpose of thedisclosure may be stored in the memory 130, and the information storedin the memory 130 may also be updated as being received from the serveror the external device or being input by the user.

The processor 140 controls an overall operation of the display device100. Specifically, the processor 140 may be connected to the componentsof the display device 100 such as the display 110, the motor 120, andthe memory 130 as described above, and may execute at least one commandstored in the memory 130 as described above to control the overalloperation of the display device 100.

The processor 140 may be implemented according to one or more schemes,among various schemes. For example, the processor 140 may be implementedas at least one of an application specific integrated circuit (ASIC), anembedded processor, a microprocessor, a hardware control logic, ahardware finite state machine (FSM), or a digital signal processor(DSP). According to an embodiment of the disclosure, the term processor140 may be used as a meaning including a central processing unit (CPU),a graphic processing unit (GPU), a main processing unit (MPU), and thelike.

In particular, in one or more embodiment of the disclosure, theprocessor 140 may rotate the display 110 and display the content on therotated display 110, and therefore, hereinafter, one or more embodimentsof the disclosure by a control of the processor 140 will be described indetail.

The processor 140 receives a user command for controlling the displaydevice 100. Specifically, the processor 140 may receive the user commandthrough the user terminal 200 connected to communicate with the displaydevice 100 through a communicator 150, and may also receive the usercommand through the remote control device 300 for controlling thedisplay device 100 through the communicator 150.

As described above, the user terminal 200 refers to a device capable ofcommunicating with the display device 100 and transmitting the controlsignal and the image content to the display device 100, and the remotecontrol device 300 refers to a device capable of receiving the userinput for controlling the display device 100 and outputting the controlsignal for controlling the display device 100 based on the received userinput.

When the user command for controlling the display device 100 isreceived, the processor 140 may determine an orientation of the displaybased on the type of the user command. Here, the determining of theorientation of the display includes not only determining the orientationof the display as a landscape orientation or a portrait orientation, butalso determining that the orientation of the display is beingmaintained. Hereinafter, one or more embodiments of determining theorientation of the display based on the type of user command will bedescribed in detail.

When the received user command is to control a first content beingdisplayed on the display, the processor 140 may determine that theorientation of the display as being maintained. That is, when thereceived user command is to change a setting related to the firstcontent while maintaining the first content being displayed on thedisplay, the processor 140 may maintain the orientation of the displayto be same as the orientation of the display prior to receiving the usercommand. For example, when the received user command is to change avolume setting of the first content or to pause playback of the firstcontent, the processor 140 may determine to maintain the orientation ofthe display.

According to an embodiment, when the received user command is to displaya second content on the display, the processor 140 may determine theorientation of the display based on the type of the second content. Thatis, when the received user command is to display the second contentdifferent from the first content without displaying the first contentbeing displayed on the display, the processor 140 may determine theorientation of the display based on the type of the second content.

Here, the determining of the orientation of the display based on thetype of the second content may be determined depending on whether it isappropriate to display the second content on the display rotated in thelandscape orientation or whether it is appropriate to display the secondcontent on the display rotated in the portrait orientation.

Specifically, the type of the second content may be determined dependingon whether the second content relates to broadcast content, to DVDcontent, to game content, to web page content, to e-book content, and tocontent corresponding to a screen being displayed on an external devicesuch as the user terminal 200.

For example, when the second content is the broadcast content, theprocessor 140 may determine the orientation of the display as thelandscape orientation. Here, the broadcast content may include not onlycontent received from terrestrial channels, cable channels, andsatellite channels, but also content received from a server providing anonline streaming site. As another example, when the second content isthe web page content, the processor 140 may determine the orientation ofthe display as the orientation only when a server providing the web pageprovides a web page in a mobile mode.

According to an embodiment, the type of the second content may bedetermined based on various attributes such as an aspect ratio of thesecond content, a provider of the second content, and the like. Forexample, when the aspect ratio of the second content is less than 1,that is, when a landscape length of the second content is shorter than aportrait length, the processor 140 may determine the orientation of thedisplay as the portrait orientation.

According to an embodiment, the second content may be video content, butthe second content may also be speech content according to anotherembodiment. That is, when a user command for outputting the secondcontent, which is the speech content, while the first content isdisplayed on the display, the processor 140 may determine to maintainthe orientation of the display.

In the above description, the process of determining the orientation ofthe display based on the type of the second content has been describedabove, and therefore, the orientation of the display corresponding tothe type of the second content may be pre-stored in the memory 130 andmay also be updated according to a setting of the user.

In addition, the orientation of the display corresponding to the type ofthe second content may be obtained through a learned artificialintelligence model. Specifically, the processor 140 may obtaininformation on the orientation of the display corresponding to the typeof the second content by inputting information on the type of the secondcontent into the artificial intelligence model, and may also determinethe orientation of the display based on the obtained information on theorientation.

Specifically, the artificial intelligence model according to thedisclosure may include at least one artificial neural network and may belearned by deep learning. Specifically, the artificial intelligencemodel may include at least one of a deep neural network (DNN), aconvolutional neural network (CNN), a recurrent neural network (RNN), ora generative adversarial network (GAN).

According to an embodiment, when a user command for displaying thesecond content is received from the remote control device 300 while thefirst content is displayed on the display, the processor 140 maydetermine the orientation of the display as the landscape orientation.For example, when a channel change command for displaying the secondcontent is received from the remote control device 300 while the firstcontent is displayed on the display rotated in the portrait orientation,the processor 140 may determine the orientation of the display as thelandscape orientation, rotate the display in the determined landscapeorientation, and display the second content on the display rotated inthe landscape orientation.

According to an embodiment, when a user command for turning on thedisplay device is received from the remote control device 300 in a statein which the display device 100 is turned off, the display device 100may also determine the orientation of the display as the landscapeorientation. According to an embodiment, the processor 140 may receivecontent corresponding to content displayed on a screen of the userterminal 200 and display the received content from the user terminal 200on the display 110. That is, the display device 100 may perform aso-called mirroring process. In addition, when the processor 140performs the mirroring process and displays the content corresponding tothe screen being displayed on the user terminal 200 on the display, theprocessor 140 may determine the orientation of the display based oninformation on a orientation of the user terminal 200.

Specifically, when a user command for displaying the second content onthe display is received while the first content is displayed on thedisplay, the processor 140 may receive the second content and theinformation on the orientation of the user terminal 200 from the userterminal 200. In addition, when the second content is the contentcorresponding to the content displayed on the screen of the userterminal 200, the processor 140 may determine the orientation of thedisplay based on the information on the orientation of the user terminal200. For example, when the orientation of the user terminal 200 is theportrait orientation, the processor 140 may determine the orientation ofthe display as the portrait orientation, and when the orientation of theuser terminal 200 is the landscape orientation, the processor 140 maydetermine the orientation of the display as the landscape orientation.

However, when the mirroring process as described above is performed, thecontent displayed on the screen of the user terminal 200 is generallytransmitted to the display device 100 as a transmission image in thelandscape orientation. Therefore, even in the case in which theorientation of the user terminal 200 is the portrait orientation and theuser terminal 200 displays content in the portrait orientation, the userterminal 200 transmits the content corresponding to content displayed onthe screen of the user terminal 200 to the display device 100 as thetransmission image by generating a landscape oriented image withoutrotating displayed in the portrait orientation as illustrated image 71in FIG. 7. As such, a size of the content included in the transmissionimage is reduced as compared to the case in which the content istransmitted as the transmission image in the portrait orientation.Furthermore, when the processor 140 enlarges the size of the content ina process of displaying the received transmission image on the display110 in the portrait orientation. Therefore, in this case, deteriorationof the image may be caused.

Therefore, according to an embodiment of the disclosure, when theorientation of the user terminal 200 is the portrait orientation, theuser terminal 200 may transmit content in which the content displayed onthe screen of the user terminal 200 is rotated in the landscapeorientation to the display device 100, and the processor 140 may controlthe display 110 to rotate the content rotated in the landscapeorientation in the portrait orientation again and display the contentrotated in the portrait orientation on the display 110 in the portraitorientation.

Specifically, when information indicating that the orientation of theuser terminal 200 is the portrait orientation and the content in whichthe content displayed on the screen of the user terminal 200 is rotatedin the landscape orientation are received from the user terminal 200,the processor 140 may determine the orientation of the display 110 asthe portrait orientation. Thereafter, the processor 140 may rotate thedisplay 110 to correspond to the determined portrait orientation,process the received content so that the received content is displayedin the portrait orientation on the display 110, and display theprocessed content on the display 110.

According to an embodiment, the processor 140 may also determine theorientation of the display 110 based on attributes of the content beingdisplayed on the user terminal 200 regardless of the orientation of theuser terminal 200.

For example, when the content corresponding to the content displayed onthe screen of the user terminal 200 is received from the user terminal200, the processor 140 may identify whether or not a blank region existson left and right sides of the received content. In addition, when theblank region does not exist on the left and right sides of the receivedcontent, the processor 140 may determine the orientation of the display110 as the landscape orientation. According to an embodiment, when theblank region exists on the left and right sides of the received content,the processor 140 may determine the orientation of the display 110 asthe portrait orientation. According to an embodiment, the blank regionmay be a dark region (i.e., black region) or a white region.

According to an embodiment of the disclosure, when the communicationconnection between the display device 100 and the user terminal 200 isterminated, the processor 140 may also determine the orientation of thedisplay 110 based on information indicating that the communicationconnection with the user terminal 200 is terminated.

Specifically, when the communication connection between the displaydevice 100 and the user terminal 200 is terminated while the mirroringprocess as described above is performed, the processor 140 may determinethe orientation of the display 110 to be the landscape orientation. Inthis case, the processor 140 may rotate the display 110 into thelandscape orientation to correspond to the determined landscapeorientation, and may also display content which is pre-stored in thememory 130 on the display 110 rotated in the landscape orientation.

In particular, when the user progresses an initial setting of thedisplay device 100 according to the disclosure, that is, out-of-boxexperience (OOBE), the OOBE may be started through the user terminal 200connected to communicate with the display device 100. In addition, theprocessor 140 may rotate the display 110 of the display device 100 intothe landscape orientation or the portrait orientation according to thetype of a screen for OOBE progression, and display the screen for OOBEprogression on the rotated display 110. According to an embodiment, whenan error occurs while the OOBE is in progress through the user terminal200, the processor 140 may rotate the display 110 of the display device100 in the landscape orientation to progress the OOBE through thedisplay 110 and may also display the screen for OOBE progression on therotated display 110.

According to an embodiment of the disclosure, the processor 140 may alsoreceive and display content corresponding to a portion of the screenbeing displayed on the user terminal 200.

For example, when the user terminal 200 displays a plurality of contentsin each of a plurality of areas divided into multiple screens ormultiple layers, the processor 140 may receive and display only contentcorresponding to one area of the plurality of areas, and in this case,one or more embodiments according to the disclosure may be applied. Forexample, when the user terminal 200 displays an image content through afirst layer and user interfaces 81, 82, 83, and 84 through a secondlayer as illustrated in FIG. 8A or 8B, the processor 140 may alsoreceive and display only the image content corresponding to the firstlayer among the screens being displayed on the user terminal 200.

According to an embodiment, when the display device 100 is rotated toreflect the information on the orientation of the user terminal 200 inreal time, as in a case in which a rotation angle of the user terminal200 is not large or a case in which the orientation of the user terminal200 is changed quickly and repeatedly, the rotation of the display ofthe display device may be contrary to an intent of the user.

Therefore, according to an embodiment of the disclosure, the processor140 may determine whether the orientation of the user terminal 200 ismaintained for a specified amount of time based on the information onthe orientation of the user terminal 200 received from the user terminal200. and determine the orientation of the display 110 based on theinformation on the orientation of the user terminal 200 only when it isdetermined that the orientation of the user terminal 200 is maintainedfor the specified amount of time, thereby preventing the rotation of thedisplay device 100 that is contrary to the intent of the user. Accordingto an embodiment, the specified amount of time may be a predeterminedamount of time.

According to an embodiment, the processor 140 may further determine ifthe rotation angle is larger than specified angle, and determine theorientation of the display 110 based on the information on theorientation of the user terminal 200 only when it is determined that therotation angle is larger than the specified angle thereby preventing therotation of the display device 100 that is contrary to the intent of theuser. According to an embodiment, the specified angle may be apredetermined angle.

As described above, when the orientation of the display 110corresponding to the type of the user command is determined, theprocessor 140 controls the motor 120 so that the display 110 correspondsto the determined orientation. Here, the controlling of the motor 120 sothat the display 110 corresponds to the determined orientation includesnot only rotating the display 110 to correspond to the determinedorientation when the display 110 is in a state that does not correspondto the orientation direction, but also not rotating (i.e. maintaining)the display 110 when the display 110 is already in a state correspondingto the determined orientation.

When the display 110 is controlled to correspond to the determinedorientation, the processor 140 may display content corresponding to auser command on the display 110. Specifically, when the received usercommand is to control a first content while the first content isdisplayed on the display, the processor 140 may maintain the firstcontent displayed on the display. When the received user command is todisplay a second content while the first content is displayed on thedisplay, the processor 140 may display the second content on thedisplay. For example, when the display 110 is rotated in the landscapeorientation to correspond to the determined orientation, the processor140 may display the content corresponding to the user command on thedisplay 110 rotated in the landscape orientation.

FIG. 3 is a block diagram illustrating in detail the configuration ofthe display device 100 according to an embodiment of the disclosure.

As illustrated in FIG. 3, the display device 100 according to anembodiment of the disclosure may further include a communicator 150, aspeaker 170, and a, microphone 160, in addition to the display 110, themotor 120, the memory 130, and the processor 140. However, such aconfiguration is exemplary, and in implementing the disclosure, a newconfiguration may be added or some configurations may be omitted inaddition to such a configuration. The display 110, the motor 120, thememory 130, and the processor 140 have been described above withreference to FIG. 2, and the communicator 150, the speaker 170, themicrophone 160, and the like will thus be described in detail below.

The communicator 150 may include a circuit and perform communicationwith a server or an external device. Specifically, the processor 140 mayreceive a variety of data or information from the server or the externaldevice connected through the communicator 150, and may also transmit avariety of data or information to the server or the external device.

The communicator 150 may include at least one of a wireless fidelity(WiFi) module 151, a Bluetooth module 152, a wireless communicationmodule 153, a near field communication (NFC) module 154, or an infrared(IR) module 155. Specifically, each of the WiFi module 151 and theBluetooth module 142 may perform communication in a WiFi manner and aBluetooth manner. In the case of using the WiFi module 151 or theBluetooth module 152, a variety of connection information such as aservice set identifier (SSID) and the like, are first transmitted andreceived, communication is connected using the connection information,and a variety of information may then be transmitted and received.

In addition, the wireless communication module 153 may performcommunication according to various communication protocols such asInstitute of Electrical and Electronics Engineers (IEEE), Zigbee, 3rdgeneration (3G), 3rd generation partnership project (3GPP), long termevolution (LTE), 5th generation (5G), and the like. The NFC module 154may perform communication in the NFC manner using a band of 13.56 MHzamong various radio frequency identification (RF-ID) frequency bandssuch as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, 2.45 GHz, and thelike.

In addition, the IR communication module 155 may include an IR receivingmodule and an IR transmitting module. The IR receiving module mayreceive an infrared signal output from the outside of the display device100, and include an infrared light receiving transistor(phototransistor) for receiving infrared light and an infrared lightreceiving module for demodulating a modulated infrared signal. The IRtransmitting module may output the infrared signal to the outside of thedisplay device 100, and include an infrared rays emitting diode (IRED)for generating the infrared signal.

In particular, in one or more embodiments according to the disclosure,the processor 140 may receive the user command from the user terminal200 through the communicator 150, and receive the user command from theremote control device 300 through the communicator 150. In addition, theprocessor 140 may receive various information such as the contentcorresponding to the screen being displayed on the user terminal 200 andthe information on the orientation of the user terminal 200 from theuser terminal 200 through the communicator 150.

The speaker 170 may output audio data by a control of the processor 140and an indicator may be turned on by the control of the processor 140.In particular, in one or more embodiments according to the disclosure,the speaker 170 may output speech content provided according to the usercommand.

The microphone 160 may receive a speech signal and convert the receivedspeech signal into an electrical signal. In particular, in one or moreembodiments according to the disclosure, the user command forcontrolling the display device 100 may be input through the microphone160. Hereinafter, an embodiment in which a user command corresponding toa received user speech is obtained by performing speech recognition onthe received user speech and an orientation of the display 110 isdetermined based on the type of the obtained user command will bedescribed in detail.

Specifically, the processor 140 may obtain the user speech through themicrophone 160, and obtain the user command corresponding to thereceived user speech by performing the speech recognition on thereceived user speech. More specifically, the processor 140 may receivethe user speech through the microphone 160 and obtain the user commandcorresponding to the received user speech by inputting the received userspeech to a learned artificial intelligence model. In addition, when theuser command corresponding to the received user speech is obtained, theprocessor 140 may determine the orientation of the display 110 based onthe type of the user command as described above.

A process of controlling the display device 110 according to thedisclosure based on the user command according to the user speech willhereinafter be described in detail with reference to FIGS. 4 and 5.

According to an embodiment, a speech recognition process of obtainingthe user command corresponding to the received user speech may beperformed through the learned artificial intelligence model. Theartificial intelligence model according to the disclosure may include atleast one artificial neural network and may be learned by deep learning.Specifically, the artificial intelligence model may include at least oneof a deep neural network (DNN), a convolutional neural network (CNN), arecurrent neural network (RNN), or a generative adversarial network(GAN).

However, specific artificial neural network models included in theartificial intelligence model according to the disclosure are notlimited to the above-described examples. The speech recognition processand the artificial intelligence model according to the disclosure willbe described in detail with reference to FIGS. 12 and 13.

FIGS. 4 and 5 are diagrams illustrating in detail a process ofcontrolling the display device 100 according to the disclosure based ona user command according to a user speech.

The user command according to the disclosure may be obtained based onthe received user speech. Specifically, the display device 100 mayreceive the user speech and obtain the user command corresponding to thereceived user speech by inputting the received user speech to a learnedartificial intelligence model.

Here, the user speech may be input through the display device 100, andmay also input through the user terminal 200 connected to communicatewith the display device 100. In addition, the speech recognition for theinput user speech may be performed through an artificial intelligencemodel included in the display device 100 or the user terminal 200 in anon-device manner, and may also be performed through an artificialintelligence model included in a server connected to communicate withthe display device 100 or the user terminal 200.

When the user command corresponding to the received user speech isobtained, the display device 100 may determine the orientation of thedisplay based on the type of the user command.

Specifically, when the user speech is received while the first contentis displayed on the display, the display device 100 may obtain the usercommand corresponding to the received user speech by inputting thereceived user speech to a first artificial intelligence model. Inaddition, when the obtained user command is to control the firstcontent, the display device 100 may determine the orientation of thedisplay as being maintained. According to an embodiment, when theobtained user command is to display the second content on the display,the display device 100 may determine the orientation of the displaybased on the type of the second content.

According to an embodiment of the disclosure, the display device 100 maydetermine the orientation of the display depending on whether the usercommand corresponding to the user speech is to output speech content oris to display image content.

Specifically, when the user command corresponding to the user speech isto output the speech content, the display device 100 may determine tomaintain the orientation of the display. Thereafter, the display device100 may control the display to correspond to the determined orientation,and output the speech content corresponding to the user command. Whilethe speech content is output, the display device 100 may also maintainthe image content being displayed on the display and may also display animage indicating that the speech content is output.

For example, as illustrated in FIG. 4, when a user speech such as “Whatis the winner of this year's film festival?” is received, the displaydevice 100 may output speech content such as “Love” without changing theorientation of the display.

According to an embodiment, when the user command corresponding to theuser speech is to display the image content, the display device 100 maydetermine the orientation of the display as the landscape orientation.Thereafter, the display device 100 may control the display to correspondto the determined orientation, and display the image contentcorresponding to the user command.

For example, as illustrated in FIG. 4, when a user speech such as “Showme more information” is received, the display device 100 may rotate thedisplay into the landscape orientation and display the image contentcorresponding to the user command on the rotated display.

According to an embodiment of the disclosure, the display device 100 maydetermine the orientation of the display depending on whether the usercommand corresponding to the user speech is to display a search resultfor a plurality of contents or is to display image content.

Specifically, when the first user command corresponding to a first userspeech is to display the search result for the plurality of contents,the display device 100 may determine the orientation of the display asthe portrait orientation. Thereafter, the display device 100 may controlthe display to correspond to the determined orientation, and displaycontent corresponding to the user command on the display.

For example, as illustrated in FIG. 5, when a user speech such as “Showme the song list for group ABC” is received, the display device 100 mayrotate the display in the portrait orientation, and display the searchresult for the plurality of contents according to the first user commandon the display rotated in the portrait orientation.

As described above, when a second user speech is received while thesecond content is displayed on the display rotated in the portraitorientation, the display device 100 may obtain a second user commandcorresponding to the received second user speech by inputting thereceived second user speech to the first artificial intelligence model.In addition, when the obtained second user command is to display oneimage content of the plurality of contents displayed according to thefirst user command on the display, the display device 100 may determinethe orientation of the display as the landscape orientation. Thereafter,the display device 100 may control the display to correspond to thedetermined landscape orientation, and display content corresponding tothe second user command on the display.

For example, as illustrated in FIG. 5, when a user speech such as “Playthe love music video” is received, the display device 100 may rotate thedisplay in the landscape orientation and display the image contentcorresponding to the second user command on the display rotated in thelandscape orientation.

In addition, the display device 100 may determine the orientation of thedisplay based on the type of the user command corresponding to varioususer speeches, and the disclosure is not limited to the examples asdescribed above.

FIG. 6 is a block diagram illustrating a configuration of the userterminal 200 according to an embodiment of the disclosure and FIG. 7 isa diagram illustrating in detail a process of controlling the displaydevice 100 according to the disclosure based on information on theorientation of the user terminal 200.

As illustrated in FIG. 6, the user terminal 200 according to anembodiment of the disclosure may include a communicator 210, a display220, a sensor 230, a memory 240, and a processor 250. However, such aconfiguration is exemplary, and in implementing the disclosure, adifferent configuration for the user terminal 200 may be added. Forinstance, one or more components from the configuration in FIG. 6 may beomitted or one or more other components may be added or combined intoanother component in the configured in FIG. 6.

The communicator 210 may include a circuit and perform communicationwith a server or an external device. Specifically, the processor 250 mayreceive data or information from the server or the external deviceconnected through the communicator 210, and may also transmit data orinformation to the server or the external device. The data or theinformation that is received and transmitted may include a variety ofdata or a variety of information. The communicator 210 may include atleast one of WiFi module, a Bluetooth module, a wireless communicationmodule, or an NFC module.

In particular, in one or more embodiments according to the disclosure,the processor 250 may control the communicator 210 to transmit theinformation on the content corresponding to the screen being displayedon the user terminal 200 and the orientation of the user terminal 200 tothe display device 100.

The display 220 may output image data by a control of the processor 250.Specifically, the display 220 may output image which is pre-stored inthe memory 240 by the control of the processor 250. In particular, thedisplay 220 may also display a user interface stored in the memory 240.

The display 220 may be implemented as a liquid crystal display (LCD)panel, an organic light emitting diode (OLED) or the like, and may alsoimplemented as a flexible display, a transparent display, or the like insome cases. However, the display 220 according to the disclosure is notlimited to a particular kind.

In particular, according to one or more embodiments of the disclosure,the display 220 may display various user interfaces capable of receivingthe user command for controlling the display device 100 connected tocommunicate with the user terminal 200.

The sensor 230 may include at least one of an acceleration sensor or agyro sensor. The acceleration sensor is a sensor capable of measuringacceleration of the display device 100 and is also referred to as anaccelerometer. The gyro sensor is a sensor capable of measuring angularvelocity and is also referred to as a gyroscope.

In particular, in one or more embodiments according to the disclosure,the processor 250 may obtain the information on the orientation of theuser terminal 200 through the sensor 230. That is, the processor 250 mayobtain information on whether the user terminal 200 is in a state inwhich the user terminal 200 is rotated in the landscape orientation oris in a state in which the user terminal 200 is rotated in the portraitorientation through the sensor 230.

At least one command regarding the user terminal 200 may be stored inthe memory 240. In addition, the memory 240 may store an operatingsystem (O/S) for driving the user terminal 200. In addition, the memory240 may also store various software programs or applications foroperating the user terminal 200 according to one or more embodiments ofthe disclosure. In addition, the memory 240 may include a semiconductormemory such as a flash memory or the like, or a magnetic storing mediumsuch as a hard disk or the like.

Specifically, the memory 240 may store various software modules foroperating the user terminal 200 according to one or more embodiments ofthe disclosure, and the processor 250 may execute the various softwaremodules stored in the memory 240 to control an operation of the userterminal 200. That is, the memory 240 is accessed by the processor 250,and readout, writing, correction, deletion, update, and the like of datain the memory 240 may be performed by the processor 250.

According to an embodiment of the disclosure, a term ‘memory’ may beused as a meaning including the memory 240, a read only memory (ROM) inthe processor 250, a random access memory (RAM), or a memory card (forexample, a micro secure digital (SD) card or a memory stick) mounted inthe display device 100.

In particular, in one or more embodiments according to the disclosure,the memory 240 may store the information on the content corresponding tothe screen being displayed on the user terminal 200 and the informationon the orientation of the user terminal 200. In addition, the memory 240may store various user interfaces capable of receiving the user commandfor controlling the user terminal 200.

The processor 250 controls an overall operation of the user terminal200. Specifically, the processor 250 may be connected to the componentsof the user terminal 200 including the communicator 210, the display220, the sensor 230, and the memory 240 as described above, and mayexecute at least one command stored in the memory 240 as described aboveto control the overall operation of the user terminal 200.

The processor 250 may be implemented in various schemes. For example,the processor 250 may be implemented as at least one of an applicationspecific integrated circuit (ASIC), an embedded processor, amicroprocessor, a hardware control logic, a hardware finite statemachine (FSM), or a digital signal processor (DSP). According to anembodiment of the disclosure, the term processor 250 may be used as ameaning including a central processing unit (CPU), a graphic processingunit (GPU), a main processing unit (MPU), and the like.

In particular, the processor 250 may display the content correspondingto the screen being displayed on the display 220 of the user terminal200 on the display 110 of the display device 100 by transmitting thecontent corresponding to the screen being displayed on the display 220of the user terminal 200 to the display device 100, and this is referredto as a so-called mirroring.

However, when the mirroring process is performed, the screen beingdisplayed on the display 220 of the user terminal 200 is generallytransmitted to the display device 100 as a transmission image in thelandscape orientation. Therefore, as illustrated in FIG. 7, in the casein which the orientation of the user terminal 200 is the portraitorientation and the user terminal 200 displays content 70 in theportrait orientation, when the user terminal 200 transmits the content70 corresponding to the content on the screen being displayed on thedisplay 220 of the user terminal 200 to the display device 100 as atransmission content 71 in the landscape orientation without rotatingthe content 70, a size of the content 70 included in the transmissioncontent 71 is reduced as compared to the case in which the content 70 istransmitted as a transmission image 72 in the portrait orientation afterrotating the content. For instance, the transmission content 71 that istransmitted in the landscape orientation without rotating the content 70may include blank regions or empty regions 73 to generate the landscapeimage. In addition, the display device 100 enlarges the size of thecontent 70 in a process of displaying the received transmission content71 on the display 110 in the portrait orientation, and in this case,deterioration of the image included in the content may be caused.

Therefore, according to an embodiment of the disclosure, when theorientation of the user terminal 200 is the portrait orientation, theprocessor 250 may rotate the portrait oriented content 70 in thelandscape orientation as content 72 and transmit the content 72 to thedisplay device 100, and the display device 100 may rotate the landscapeoriented content 72 in the portrait orientation again as portraitcontent 74 and display the content 74 rotated in the portraitorientation on the display 110 of display device 100 in the portraitorientation.

Specifically, when the orientation of the user terminal 200 is theportrait orientation, the processor 250 may transmit informationindicating that the orientation of the user terminal 200 is the portraitorientation and the content to the display device 100. For instance, thecontent transmitted to the display device 100 corresponds to thedisplayed on the display 220 of the user terminal 200 after beingrotated in the landscape orientation.

More specifically, when the user command for transmitting the contentcorresponding to the screen being displayed on the display 220 of theuser terminal 200 to the display device 100 is input, the processor 250may perform a communication connection with the display device 100through the communicator 210. In addition, when the informationindicating that the orientation of the user terminal 200 is the portraitorientation is obtained through the sensor 230, the processor 250 mayobtain the content in which the screen being displayed on the display220 is rotated in the landscape orientation, and control thecommunicator 210 to transmit the information indicating that theorientation of the user terminal 200 is the portrait orientation and theobtained content to the display device 100 connected to the userterminal 200.

According to an embodiment, when the orientation of the user terminal200 is the portrait orientation, the processor 250 may transmitinformation on a resolution of the screen being displayed on the display220 of the user terminal 200 and the content 72 in which the screenbeing displayed on the display 220 of the user terminal 200 is rotatedin the landscape orientation to the display device 100. When theinformation on a resolution of the screen being displayed on the display220 of the user terminal 200 and the content 72 in which the screenbeing displayed on the display 220 of the user terminal 200 is rotatedin the landscape orientation are received, the display device 100 mayidentify an aspect ratio of the screen being displayed on the display220 of the user terminal 200 based on the received information on theresolution. In addition, when a landscape length of the screen beingdisplayed on the display 220 of the user terminal 200 is shorter than aportrait length thereof, the display device 100 may determine theorientation of the display as the portrait orientation, rotate thecontent 72 rotated in the landscape orientation in the portraitorientation again, and display the content 74 rotated in the portraitorientation on the display 110 in the portrait orientation.

According to an embodiment, when the display device 100 is rotated byreflecting the information on the orientation of the user terminal 200in real time, as in a case in which a rotation angle of the userterminal 200 is not large or a case in which the orientation of the userterminal 200 is changed quickly and repeatedly, there may be a case thatis contrary to an intent of the user.

Therefore, according to an embodiment of the disclosure, the processor250 may prevent the rotation of the display device 100 that is contraryto the intent of the user by transmitting the information on theorientation of the user terminal 200 to the display device 100 only whenthe user terminal 200 is maintained for a predetermined time at apredetermined angle or more.

According to an embodiment, while the mirroring process as describedabove is performed, a guide message informing that the user terminal 200has received a call, a text message, or an e-mail may be received. Inthis case, the user terminal 200 may display a message inquiring whetherto output information on the received call, text message, or e-mailthrough the display device 100, and display the information on thereceived call, text message, or e-mail on the display device 100according to a selection of the user.

According to an embodiment, when the information on the call, textmessage, or e-mail received by the user terminal 200 is displayed on thedisplay device 100, whether to rotate the display of the display device100 may be determined according to the one or more embodiments asdescribed above. For example, when the information on the received textmessage is displayed on the display device 100, the display device 100may determine the orientation of the display as the portraitorientation. According to an embodiment, when the information on thereceived call is displayed on the display device 100, the display device100 may determine the orientation of the display as being maintained.

According to an embodiment, the control process of the processor 250 asdescribed above may also be applied to a controlling method of the userterminal 200 in the same way. Specifically, the controlling method ofthe user terminal 250 includes an operation of performing acommunication connection with the display device 100 when the usercommand for transmitting the content corresponding to the screen beingdisplayed on the display 220 of the user terminal 200 is input, anoperation of obtaining the content in which the screen being displayedon the display 220 is rotated in the landscape orientation when theinformation indicating that the orientation of the user terminal 200 isthe portrait orientation, and an operation of transmitting theinformation indicating that the orientation of the user terminal 200 isthe portrait orientation and the obtained content to the display device100 connected to the user terminal 200.

According to an embodiment, the controlling method of the user terminal200 as described above may be implemented by a program and provided tothe display device. In particular, the problem including the controllingmethod of the user terminal 200 may be stored in a non-transitorycomputer readable medium and provided.

Specifically, in a computer readable recording medium including aprogram that executes a controlling method of a user terminal 250, thecontrolling method of the user terminal 250 includes an operation ofperforming a communication connection with the display device 100 whenthe user command for transmitting the content corresponding to thescreen being displayed on the display 220 of the user terminal 200 isinput, an operation of obtaining the content in which the screen beingdisplayed on the display 220 is rotated in the landscape orientationwhen the information indicating that the orientation of the userterminal 200 is the portrait orientation, and an operation oftransmitting the information indicating that the orientation of the userterminal 200 is the portrait orientation and the obtained content to thedisplay device 100 connected to the user terminal 200.

Here, the non-transitory computer readable medium is not a medium thatstores data for a short time such as a register, a cache, a memory, orthe like, but means a machine readable medium that semi-permanentlystores data. Specifically, various applications or programs describedabove may be stored and provided in the non-transitory computer readablemedium such as a compact disk (CD), a digital versatile disk (DVD), ahard disk, a Blu-ray disk, a universal serial bus (USB), a memory card,a read only memory (ROM), or the like.

FIGS. 8A and 8B are diagrams illustrating a user interface of the userterminal 200 according to an embodiment of the disclosure.

According to one or more embodiments described above, the orientation ofthe display included in the display device 100 is determined based onthe information on the orientation of the user terminal 200. However,the user command for rotating the display of the display device 100 mayalso be directly input through the user terminal 200 and the display ofthe display device 100 may be rotated based on the user command inputthe user terminal 200. For instance, the user command may expresslyindicate a desire to perform a particular function, such as rotate thecontent.

Specifically, according to an embodiment of the disclosure, the userterminal 200 connected to communicate with the display device 100 maydisplay a user interface for receiving a user command for rotating thedisplay of the display device 100. In addition, when the user commandfor rotating the display of the display device 100 is input through theuser interface, the user terminal 200 may transmit a control signalcorresponding to the user command for rotating the display to thedisplay device 100.

Specifically, as illustrated in FIG. 8A, the user interface of the userterminal 200 may include a soft button 81 for receiving the user commandfor rotating the display of the display device 100. In addition, asillustrated in FIG. 8B, the user interface of the user terminal 200 mayalso include an icon 82 for receiving the user command for rotating thedisplay of the display device 100, an icon 83 for enlarging or reducingthe content being displayed on the display of the display device 100,and an icon 84 for terminating the communication connection with thedisplay device 100. In addition, the user interface of the user terminal200 may also include various kinds of icons for controlling the displaydevice 100.

FIGS. 8C and 8D are diagrams illustrating a process of enlarging orreducing the content being displayed on the display device 100 throughthe user terminal 200 and displaying the enlarged or reduced content.

As described above, the display device 100 may receive the contentcorresponding to the screen being displayed on the user terminal 200 anddisplay the received content on the display. That is, the display device100 may perform a so-called mirroring process. In addition, when thedisplay device 100 performs the mirroring process and displays thecontent corresponding to the screen being displayed on the user terminal200 on the display, the display device 100 may determine the orientationof the display based on information on an orientation of the userterminal 200.

According to illustrations in FIGS. 8A and 8B, the user terminal 200 maydisplay the user interface for receiving the user command for rotatingthe display of the display device 100. Therefore, according to anembodiment of the disclosure, when the display device 100 performs themirroring process and displays the content corresponding to the screenbeing displayed on the user terminal 200 on the display, the displaydevice 100 may receive the user command for rotating the display of thedisplay device 100 from the user terminal 200, and rotate the display ofthe display device 100 based on the received user command.

In FIG. 8C, the orientation of the user terminal 200 is the portraitorientation, but the orientation of the display device 100 is thelandscape orientation. This is to indicate a state in which while themirroring process is performed, the user command for rotating thedisplay in the landscape orientation is input through the user terminal200 and the display of the display device 100 is rotated accordingly.

When the mirroring process as described above is performed, the displaydevice 100 may receive the content corresponding to the screen beingdisplayed on the user terminal 200 and display the received content onthe display of the display device 100, as illustrated in a first screen810 of FIG. 8C.

When the user command for enlarging the content being displayed on thedisplay of the display device 100 is received from the user terminal200, the display device 100 may enlarge and display the content beingdisplayed on the display, as illustrated in a second screen 820 of FIG.8C. In this case, an area to be enlarged of the area on which thecontent is displayed, and an enlargement ratio of the content may bedifferently determined according to a selection of the user.

When a user command for displaying image content 85 of the content beingdisplayed on the display of the display device 100 as an entire screenis received from the user terminal 200, the display device 100 mayenlarge the content being displayed on the display and display the imagecontent as the entire screen, as illustrated in a third screen 830 ofFIG. 8C.

FIG. 8D is a diagram illustrating a process of enlarging or reducing thecontent being displayed on the display device 100 through the userterminal 200 and displaying the enlarged or reduced content when theorientation of the user terminal 200 is the portrait orientation and theorientation of the display device 100 is also the portrait orientation.

When the mirroring process as described above is performed, the contentcorresponding to the screen being displayed on the user terminal 200 maybe displayed on the display of the display device 100, as illustrated ina first screen 840 of FIG. 8D. In this case, a notification bar 86 andleft and right blank areas 87 may be displayed together on the displayof the display device 100. Here, the left and right blank areas 87 areattributable to a difference in a screen ratio between the display ofthe user terminal 200 and the display of the display device 100.

When the user command for enlarging the content being displayed on thedisplay of the display device 100 is received from the user terminal200, the display device 100 may enlarge and display the content beingdisplayed on the display. In this case, the display device may enlargeand display the content so that the notification bar 86 and the left andright blank areas 87 are not displayed, as illustrated in a secondscreen 850 of FIG. 8D.

According to an embodiment, although not specifically illustrated inFIG. 8D, similar to the case illustrated in FIG. 8C, even in a case inwhich the mirroring function is performed in a state in which thedisplay of the display device 100 is rotated in the portraitorientation, the user command for displaying the image content of thecontent being displayed on the display as the entire screen may beinput.

When the user command for displaying the image content of the contentbeing displayed on the display of the display device 100 as the entirescreen is received from the user terminal 200, the display device 100may rotate the display of the display device based on an aspect ratio ofthe image content to be displayed as the entire screen according to theuser command.

Specifically, when the user command for displaying the image content ofthe content being displayed on the display as the entire screen isreceived from the user terminal 200 and the aspect ratio of the imagecontent to be displayed as the entire screen is greater than 1, thedisplay device 100 may rotate the display of the display device 100 inthe landscape orientation and display the image content as the entirescreen on the display rotated in the landscape orientation.

According to an embodiment, only the case of enlarging and displayingthe content being displayed on the display of the display device 100 hasbeen described, but the content being displayed on the display of thedisplay device 100 may also be reduced and displayed. Specifically, whena user command for reducing the content being displayed on the displayof the display device 100 is received from the user terminal 200, thedisplay device 100 may reduce and display the content being displayed onthe display, as illustrated in a third screen 860 of FIG. 8D. Similarlyto the case of enlarging and displaying the content, an area to bereduced of the area on which the content is displayed, and a reductionratio of the content may be differently determined according to aselection of the user.

FIG. 9 is a diagram illustrating the remote control device 300 accordingto an embodiment of the disclosure.

As illustrated in FIG. 9, the remote control device 300 may include aplurality of buttons for controlling the display device 100. Inaddition, each of the plurality of buttons corresponds to at least oneof the user commands for controlling the display device 100. That is,when the user presses one of the plurality of buttons, the remotecontrol device 300 may transmit a control signal corresponding to thecorresponding button to the display device 100. As illustrated in FIG.9, the plurality of button may include a power button 91, a volumeadjustment button 92, a play/pause button 93, a channel adjustmentbutton 94, and the like.

According to an embodiment of the disclosure, when the control signalcorresponding to the user command is received from the remote controldevice 300 for controlling the display device 100, the display device100 may determine the orientation of the display based on a function ofthe display device 100 corresponding to the control signal.

For example, when the remote control device 300 transmits a controlsignal corresponding to the power button 91 or the volume adjustmentbutton 92 to the display device 100 and the display device 100 receivesthe control signal corresponding to the power button 91 or the volumeadjustment button 92, the display device 100 may determine theorientation of the display corresponding to a function of the displaydevice 100 such as power on/off or volume adjustment as the portraitorientation.

According to an embodiment, when the remote control device 300 transmitsa control signal corresponding to the play/pause button 93 or thechannel adjustment button 94 to the display device 100 and the displaydevice 100 receives the control signal corresponding to the play/pausebutton 93 or the channel adjustment button 94, the display device 100may determine the orientation of the display corresponding to a functionof the display device 100 such as play/pause or channel adjustment asthe landscape orientation.

The example as described above is merely an example of determining theorientation of the display corresponding to the function of the displaydevice 100, and the orientation of the display corresponding to eachfunction of the display device 100 may be changed by a setting of theuser or the like.

FIG. 10 is a diagram illustrating a user interface of the display device100 according to an embodiment of the disclosure.

The display device 100 may display a user interface. In particular, theuser interface of the display device 100 may be displayed even when thepower of the display device 100 is terminated. That is, the displaydevice 100 according to the disclosure may include a function calledso-called Always on Display (AoD).

As illustrated in FIG. 10, the user interface of the display device 100may include a clock-shaped object 1010. The clock-shaped object includedin the user interface may represent the current time.

According to an embodiment, the user interface of the display device 100may be received from the user terminal 200. In addition, the displaydevice 100 may store the received user interface and display thepre-stored user interface when the power of the display device 100 isterminated.

According to an embodiment, when a plurality of user interfaces arestored in the display device 100, the display device 100 may display oneuser interface of the plurality of pre-stored user interfaces when thepower of the display device 100 is terminated. Thereafter, when a usercommand for changing the displayed user interface to another userinterface is received, the display device 100 may change the displayeduser interface to another user interface according to the user commandand display another user interface.

According to an embodiment, as illustrated in FIG. 10, the userinterface of the display device 100 may include a guide message 1020.Specifically, the user interface may include a guide message 1020 toguide the rotation of the display. For example, the guide message 1020may be a message such as “This function is only available in landscapemode. The TV rotates in landscape mode.”

According to an embodiment, the user interface of the display device 100may include an inquiry message about whether the display is rotated andan object for receiving a user command about whether the display isrotated. For example, the inquiry message about whether the display isrotated may be a message such as “This function is only available inlandscape mode. Would you like to rotate the TV to landscape mode?”, andthe object for receiving the user command about whether the display isrotated may include a message such as “yes” or “no”. In addition, inthis case, when a user command to select an object “Yes” is input, thedisplay device 100 may rotate the display.

In addition to the examples as described above, the user interface ofthe display device 100 may display various kinds of user interfacesrelated to the control of the display device 100.

FIG. 11 is a flowchart illustrating a controlling method of the displaydevice 100 according to an embodiment of the disclosure.

As illustrated in FIG. 11, the display device 100 according to anembodiment of the disclosure receives a user command for controlling thedisplay device 100 while first content is displayed on the display ofthe display device (S1110). Specifically, the display device 100 mayreceive the user command through the user terminal 200 connected tocommunicate with the display device 100, and may also receive the usercommand through the remote control device 300 for controlling thedisplay device 100.

When the user command for controlling the display device 100 isreceived, the display device 100 may determine the orientation of thedisplay based on the type of the user command. Specifically, the displaydevice 100 may determine to maintain the orientation of the display whenthe received user command is to control the first content, and determinethe orientation of the display based on the type of the second contentwhen the received user command is to display the second content on thedisplay (S1120).

Specifically, when the received user command is to maintain the firstcontent being displayed on the display and change a setting related tothe first content, the display device 100 may determine the orientationof the display as being maintained. For example, when the received usercommand is to change a volume setting of the first content or to pauseplayback of the first content, the display device 100 may determine theorientation of the display as being maintained.

According to an embodiment, when the received user command is to displaythe second content different from the first content without displayingthe first content being displayed on the display, the display device 100may determine the orientation of the display based on the type of thesecond content.

Here, the determining of the orientation of the display based on thetype of the second content may be determined depending on whether it isappropriate to display the second content on the display rotated in thelandscape orientation or whether it is appropriate to display the secondcontent on the display rotated in the portrait orientation.

Specifically, the type of the second content may be determined dependingon whether the second content relates to broadcast content, to DVDcontent, to game content, to web page content, to e-book content, and tocontent corresponding to a screen being displayed on an external devicesuch as the user terminal 200.

For example, when the second content is the broadcast content, thedisplay device 100 may determine the orientation of the display as thelandscape orientation. Here, the broadcast content may include not onlycontent received from terrestrial channels, cable channels, andsatellite channels, but also content received from a server providing anonline streaming site. As another example, when the second content isthe web page content, the display device 100 may determine theorientation of the display as the portrait orientation only when aserver providing the web page provides a web page in a mobile mode.

According to an embodiment, the type of the second content may bedetermined based on various attributes such as an aspect ratio of thesecond content, a provider of the second content, and the like. Forexample, when the aspect ratio of the second content is less than 1,that is, when a landscape length of the second content is shorter than aportrait length, the display device 100 may determine the orientation ofthe display as the portrait orientation.

According to an embodiment, in the above description, it is assumed thatthe second content is video content, but the second content may also bespeech content. That is, when a user command for outputting the secondcontent, which is the speech content, is received while the firstcontent is displayed on the display, the display device 100 maydetermine the orientation of the display as being maintained.

In the above description, the process of determining the orientation ofthe display based on the type of the second content has been describedabove, and therefore, the orientation of the display corresponding tothe type of the second content may be pre-stored in the display device100 and may also be updated according to a setting of the user.

In addition, the orientation of the display corresponding to the type ofthe second content may be obtained through a learned artificialintelligence model. Specifically, the display device 100 may obtaininformation on the orientation of the display corresponding to the typeof the second content by inputting information on the type of the secondcontent into the artificial intelligence model, and may also determinethe orientation of the display based on the obtained information on theorientation.

According to an embodiment, when a user command for displaying thesecond content is received from the remote control device 300 while thefirst content is displayed on the display, the display device 100 maydetermine the orientation of the display as the landscape orientation.For example, when a channel change command for displaying the secondcontent is received from the remote control device 300 while the firstcontent is displayed on the display rotated in the portrait orientation,the display device 100 may determine the orientation of the display asthe landscape orientation, rotate the display in the determinedlandscape orientation, and display the second content on the displayrotated in the landscape orientation.

According to an embodiment, the display device 100 may receive contentcorresponding to a screen being displayed on the user terminal 200 anddisplay the received content on the display. That is, the display device100 may perform a so-called mirroring process. In addition, when thedisplay device 100 performs the mirroring process and displays thecontent corresponding to the screen being displayed on the user terminal200 on the display, the display device 100 may determine the orientationof the display based on information on an orientation of the userterminal 200.

Specifically, when a user command for displaying the second content onthe display is received while the first content is displayed on thedisplay, the display device 100 may receive the second content and theinformation on the orientation of the user terminal 200 from the userterminal 200. In addition, when the second content is the contentcorresponding to the screen being displayed on the user terminal 200,the display device 100 may determine the orientation of the displaybased on the information on the orientation of the user terminal 200.For example, when the orientation of the user terminal 200 is theportrait orientation, the display device 100 may determine theorientation of the display as the portrait orientation, and when theorientation of the user terminal 200 is the landscape orientation, thedisplay device 100 may determine the orientation of the display as thelandscape orientation.

According to an embodiment, when information indicating that theorientation of the user terminal 200 is the portrait orientation and thecontent in which the screen being displayed on the user terminal 200 isrotated in the landscape orientation are received from the user terminal200, the display device 100 may determine the orientation of the displayas the portrait orientation. Thereafter, the display device 100 mayrotate the display to correspond to the determined portrait orientation,process the received content so that the received content is displayedin the portrait orientation on the display, and display the processedcontent on the display.

According to an embodiment, the user command according to the disclosuremay be input through a user speech. Specifically, when a first userspeech is received while the first content is displayed on the display,the display device 100 may obtain a user command corresponding to thereceived first user speech by inputting the received first user speechto a first artificial intelligence model. In addition, when the obtaineduser command is to control the first content, the display device 100 maydetermine the orientation of the display as being maintained. Accordingto an embodiment, when the obtained user command is to display thesecond content on the display, the display device 100 may determine theorientation of the display based on the type of the second content.

As described above, when the orientation of the display is determined,the display device 100 controls the display to correspond to thedetermined orientation (S1130). Here, the controlling of the display tocorrespond to the determined orientation includes not only rotating thedisplay to correspond to the determined orientation when the display isin a state that does not correspond to the determined orientation, butalso not rotating the display when the display is already in a statecorresponding to the determined orientation.

When the display is controlled to correspond to the determinedorientation, the display device 100 may display content corresponding toa user command on the display. Specifically, when the received usercommand is to control a first content while the first content isdisplayed on the display, the display device 100 may maintain the firstcontent displayed on the display. When the received user command is todisplay a second content while the first content is displayed on thedisplay, the display device 100 may display the second content displayedon the display.

According to an embodiment, the controlling method of the display deviceaccording to the embodiment described above may be implemented by aprogram and provided to the display device. In particular, the problemincluding the controlling method of the display device may be stored ina non-transitory computer readable medium and provided.

Specifically, in a computer readable recording medium including aprogram that executes a controlling method of a display device 100, thecontrolling method of the display device 100 includes an operation ofdetermining an orientation of a display included in the display device100 based on the type of a user command when the user command forcontrolling the display device 100 is received, an operation ofcontrolling the display to correspond to the determined orientation, andan operation of displaying content corresponding to the user command onthe display.

Here, the non-transitory computer readable medium is not a medium thatstores data for a short time such as a register, a cache, a memory, orthe like, but means a machine readable medium that semi-permanentlystores data. Specifically, various applications or programs describedabove may be stored and provided in the non-transitory computer readablemedium such as a compact disk (CD), a digital versatile disk (DVD), ahard disk, a Blu-ray disk, a universal serial bus (USB), a memory card,a read only memory (ROM), or the like.

In the above-description, the controlling method of the display device100 and the computer readable recording medium including the programthat executes the controlling method of the display device 100 have beenbriefly described, but this is merely to omit the overlappeddescription, and one or more embodiments of the display device 100 mayalso be applied to the controlling method of the display device 100 andthe computer readable recording medium including the program thatexecutes the controlling method of the display device 100.

FIG. 12 is a diagram illustrating in detail a speech recognition processaccording to an embodiment of the disclosure.

The speech recognition process according to an embodiment of thedisclosure may be performed through an artificial intelligence agentsystem as illustrated in FIG. 12. That is, according to an embodiment ofthe disclosure, the display device 100 may obtain the user commandcorresponding to the received user speech, and therefore, such a speechrecognition process may be performed through an artificial intelligencemodel. According to an embodiment of the disclosure, a speechrecognition system may be stored in the memory of the display device100. However, this is merely one example, and at least one of modulesincluded in the speech recognition system may be included in at leastone external server.

As illustrated in FIG. 12, the speech recognition system may include anautomatic speech recognition (ASR) module 1210, a natural languageunderstanding (NLU) module 1220, a dialogue manager (DM) module 1230,and a natural language generator (NLG) module 1240. In addition to this,the speech recognition system may further include a path planner moduleor an action planner module.

The automatic speech recognition (ASR) module 1210 may convert a userspeech received from the display device 100 into text data. In addition,the automatic speech recognition module 1210 may include an utterancerecognition module, and the utterance recognition module may include anacoustic model and a language model. In particular, the acoustic modelmay obtain information on an acoustic feature of the user speech.

Specifically, the acoustic model may include information related tovocalization, and the language model may include unit phonemeinformation and information on a combination of unit phonemeinformation. In addition, the utterance recognition module may convertthe user utterance into the text data by using information related tothe vocalization and the information on the unit phoneme information.The information on the acoustic model and the language model may bestored, for example, in an automatic speech recognition database (ASRDB) 1215.

When the information on the acoustic feature of the user speech isobtained based on the automatic speech recognition module 1210 asdescribed above, particularly, the acoustic model, the automatic speechrecognition module 1210 obtains information on emotion of the user basedon the obtained information on the acoustic feature of the user speech.

For example, the automatic speech recognition module 1210 may obtain theinformation on the emotion of the user by using a method of inputtingthe information on the acoustic feature of the user to an artificialintelligence model including a convolution neural network (CNN) or thelike and dividing and classifying factors of the emotion included in theuser speech.

The natural language understanding module 1220 may determine a user'sintent by performing syntactic analysis or semantic analysis.

The natural understanding module 1220 may perform the syntactic analysisby dividing the user input into syntactic units (e.g., words, phrases,morphemes, etc.) and identifying what syntactic elements the dividedunits have.

The natural understanding module 1220 may perform the semantic analysisby using a semantic matching, a rule matching, a formula matching, orthe like. Accordingly, the natural language understanding module 1220may obtain a domain, an intent, or a parameter (or slot) required torepresent the intent of the user input.

The natural language understanding module 1220 may determine the intentand the parameter of the user by using a matching rule divided into thedomain, the intent, and the parameter (slot) required to identify theintent.

For example, one domain (e.g., alarm) may include a plurality of intents(e.g., alarm setting, alarm clearing, etc.), and one intent may includea plurality of parameters (e.g., time, number of repetitions, alarmsound, etc.). In addition, a plurality of rules may include one or morerequisite element parameters. According to an embodiment, the matchingrule may be stored in the natural language understanding database (NLUDB) 1225.

The natural language understanding module 1220 may identify the meaningof word extracted from the user input by using linguistic features(e.g., syntactic elements) such as morphemes and phrases, and determinethe intent of the user by matching the identified meaning of the wordwith the domain and the intent.

For example, the natural language understanding module 1220 maydetermine the intent of the user by calculating how much the wordextracted from the user input is included in each domain and intent.According to an embodiment, the natural language understanding module1220 may determine a parameter of the user input by using a word onwhich the natural language understanding module 1220 bases to identifythe intent.

In addition, the natural language understanding module 1220 maydetermine the intent of the user by using the natural languagerecognition database 1225 in which the linguistic features foridentifying the intent of the user input are stored.

The natural language understanding module 1220 may generate a path rulebased on the intent and the parameter of the user input. For example,the natural language understanding module 1220 may select an application(i.e., “app”) to be executed based on the intent of the user input anddetermine an operation to be performed in the selected app.

The natural language understanding module 1220 may generate the pathrule by determining a parameter corresponding to the determinedoperation. According to an embodiment, the path rule generated by thenatural language understanding module 1220 may include information on anapplication to be executed, an operation to be executed in the app, anda parameter required to execute the operation.

The natural language understanding module 1220 may generate one pathrule or a plurality of path rules based on the intent and the parameterof the user input. For example, the natural language understandingmodule 1220 may receive a path rule set corresponding to the displaydevice 100 from the path planner module, and determine the path rule bymapping the intent and the parameter of the user input to the receivedpath rule set.

In this case, the path rule may include information on an operation forperforming a function of an app or information on a parameter requiredfor executing the operation. In addition, the path rule may include anoperation order of the app. The display device 100 may receive the pathrule, select an app according to the path rule, and execute an operationincluded in the path rule in the selected app.

The natural language understanding module 1220 may generate one pathrule or a plurality of path rules by determining an application to beexecuted, an operation to be executed in the app, and a parameterrequired to execute the operation based on the intent and the parameterof the user input.

For example, the natural language understanding module 1220 may generatethe path rule by arranging the app to be executed and the operation tobe executed in the app in the form of ontology or graph model accordingto the intent of the user input using the information of the displaydevice 100. The generated path rule may be stored in a path ruledatabase through the path planner module. The generated path rule may beadded to the path rule set of the database 1225.

The natural language understanding module 1220 may select at least oneof the plurality of generated path rules. For example, the naturallanguage understanding module 1220 may select an optimal path rule amongthe plurality of path rules. As another example, the natural languageunderstanding module 1220 may select the plurality of path rules whenonly some of the operations are specified based on the user utterance.The natural language understanding module 1220 may determine one pathrule among the plurality of path rules by an additional input of theuser.

The dialogue manager module 1230 may determine whether the intent of theuser identified by the natural language understanding module 1220 isclear. For example, the dialogue manager module 1230 may determinewhether the intent of the user is clear based on whether the informationof the parameter is sufficient. The dialogue manager module 1230 maydetermine whether the parameter identified by the natural languageunderstanding module 1220 is sufficient to perform the task. Accordingto an embodiment, the dialogue manager mode 1230 may determine whetherthe parameter identified by the natural language understanding module1220 is sufficient to perform the task based on one or more models andor rules stored in the Knowledge database 1235.

According to an embodiment, when the intent of the user is not clear,the dialogue manager module 1230 may perform feedback for requestingnecessary information to the user. For example, the dialogue managermodule 1230 may perform a feedback for requesting information on aparameter for identifying the intent of the user. In addition, thedialogue manager module 1230 may generate and output a message forchecking a user inquiry including a text changed by the natural languageunderstanding module 1220.

According to an embodiment, the dialogue manager module 1230 may includea content provider module. When the content provider module may performan operation based on the intent and the parameter identified by thenatural language understanding module 1220, the content provider modulemay generate a result of performing the task corresponding to the userinput.

The natural language generator (NLG) module 1240 may change designatedinformation into a text form. The information changed in the text formmay be in the form of natural language utterance. Here, the designatedinformation may be information on an additional input, information forguiding completion of an operation corresponding to the user input, orinformation (e.g., feedback information for the user input) for guidingthe additional input of the user.

The information changed into the text form may be displayed on thedisplay of the display device 100 or may be changed into a speech formby a text-to-speech (TTS) module.

FIG. 13 is a block diagram illustrating a detailed configuration of aprocessor according to an embodiment of the disclosure.

Referring to FIG. 13, the processor 140 according to some embodimentsmay include a data learner 1310 and a data recognizer 1320.

The data learner 1310 may learn a criterion for obtaining the usercommand corresponding to the received user speech and obtaining theinformation on the orientation of the display corresponding to the typeof the content according to the disclosure. The data learner 1310 maylearn a criterion about what data to use for obtaining the user commandcorresponding to the received user speech and obtaining the informationon the orientation of the display corresponding to the type of thecontent, and how to perform the obtaining of the user commandcorresponding to the received user speech and the obtaining of theinformation on the orientation of the display corresponding to the typeof the content using the data. The data learner 1310 may learn thecriterion for obtaining the user command corresponding to the receiveduser speech and obtaining the information on the orientation of thedisplay corresponding to the type of the content by obtaining data to beused for learning and applying the obtained data to an artificialintelligence model.

The data recognizer 1320 may output a result about the obtaining of theuser command corresponding to the received user speech and the obtainingof the information on the orientation of the display corresponding tothe type of the received content. The data recognizer 1320 may outputthe result about the obtaining of the user command corresponding to theuser speech received from predetermined data and the obtaining of theinformation on the orientation of the display corresponding to the typeof the content, by using a learned artificial intelligence model.

In addition, the data recognizer 1320 may output the result about theobtaining of the user command corresponding to the user speech receivedfrom predetermined data and the obtaining of the information on theorientation of the display corresponding to the type of the content, byobtaining predetermined data according to a criterion which is pre-setaccording to the leaning and using the artificial intelligence modelwith the obtained data as an input value. Alternatively, a result valueoutput by a data recognition model with the obtained data as the inputvalue may be used to update the artificial intelligence model.

At least one of the data learner 1310 or the data recognizer 1320 may bemanufactured in the form of at least one hardware chip and mounted inthe display device. For example, at least one of the data learner 1310or the data recognizer 1320 may also be manufactured in the form of adedicated hardware chip for artificial intelligence (AI), or may bemanufactured as a portion of an existing general purpose processor(e.g., CPU or application processor) or a graphic dedicated processor(e.g., GPU) and mounted in a variety of display devices described above.

In this case, the data learner 1310 and the data recognizer 1320 mayalso be mounted in one display device 100, or may also be mounted ineach of the separate display devices. For example, one of the datalearner 1310 and the data recognizer 1320 may be included in the displaydevice 100, and the other may be included in a server.

In addition, the data learner 1310 and the data recognizer 1320 may alsoprovide model information constructed by the data learner 1310 to thedata recognizer 1320 by a wired or wireless line, and the data input tothe data recognizer 1320 may also be provided to the data learner 1310as additional learning data.

Meanwhile, at least one of the data learner 1310 or the data recognizer1320 may be implemented as a software module. When at least one of thedata learner 1310 or the data recognizer 1320 is implemented as thesoftware module (or a program module including instructions), thesoftware module may be stored in a non-transitory computer readablemedia.

In addition, in this case, at least one software module may be providedby an operating system (OS), or may be provided by a predeterminedapplication. Alternatively, some of the at least one software module maybe provided by the operating system (OS), and the remaining softwaremodules may be provided by the predetermined application.

According to the one or more embodiments of the disclosure as describedabove, the display device 100 may provide various contents as a visualexperience larger than the user terminal 200 and may provide the contentthrough the display rotated to satisfy a watching experience of the userfor various contents by rotating the display based on the type of theuser command for controlling the display device 100.

Each of the components (e.g., modules or programs) according to the oneor more embodiments as described above may include a single entity or aplurality of entities, and some sub-components of the sub-componentsdescribed above may be omitted, or other sub-components may be furtherincluded in the one or more embodiments. Alternatively or additionally,some components (e.g., modules or programs) may be integrated into oneentity to perform the same or similar functions performed by therespective components prior to the integration.

The operations performed by the module, the program, or other component,in accordance with the one or more embodiments may be performed in asequential, parallel, iterative, or heuristic manner, or at least someoperations may be executed in a different order or omitted, or otheroperations may be added.

According to one or more embodiments, the term “˜ or” (i.e.,“communicator”), “˜ er” (i.e., “data learner” or “data recognizer”) or“module” used in the disclosure includes a unit composed of hardware,software, or firmware, and may be used interchangeably with the termsuch as logic, logic block, component, or circuit. The “˜ or”, “˜ er” or“module” may be an integrally formed component or a minimum unit ofperforming one or more functions or a portion thereof. For example, themodule may be configured as an application-specific integrated circuit(ASIC).

The one or more embodiments of the disclosure may be implemented bysoftware including instructions that are stored in machine-readablestorage media (e.g., a computer). The machine is an apparatus thatinvokes the stored instructions from the storage medium and is operableaccording to the invoked instruction, and may include the display device(e.g., the display device 100) according to the embodiments of thedisclosure.

When the instructions are executed by the processor, the processor mayperform functions corresponding to the instructions, either directly orusing other components under the control of the processor. Theinstructions may include codes generated or executed by a compiler or aninterpreter.

The machine-readable storage media may be provided in the form ofnon-transitory storage media. Here, the terms ‘non-transitory’ meansthat the storage media do not include a signal and is tangible, but donot distinguish whether data is stored semi-permanently or temporarilyin the storage media.

According to an embodiment, the method according to the one or moreembodiments of the disclosure may be included and provided in a computerprogram product. The computer program product may be traded as a productbetween a seller and a purchaser.

The computer program product may be distributed in the form of a machinereadable storage media (e.g., a compact disc read only memory (CD-ROM)),or online through an application store (e.g., PlayStore™). In case ofthe online distribution, at least a portion of the computer programproduct may be at least temporarily stored in a storage medium such as amemory of a relay server, a server of an application store, or a relayserver, or be temporarily generated.

Although the embodiments of the disclosure have been illustrated anddescribed hereinabove, the disclosure is not limited to theabovementioned specific embodiments, but may be variously modified bythose skilled in the art to which the disclosure pertains withoutdeparting from the gist of the disclosure. These modifications shouldalso be understood to fall within the scope and spirit of thedisclosure.

What is claimed is:
 1. A display device comprising: a communicator; adisplay; a motor configured to rotate the display; a memory configuredto store at least one instruction; and a processor configured to executethe at least one instruction, wherein the processor is configured to:based on receiving, from a user terminal connected to the display devicethrough the communicator, transmission image data that correspond to ascreen displayed on the user terminal and have a standard in ahorizontal direction and information indicating that the transmissionimage data is generated by rotating a first content corresponding to thescreen in the horizontal direction, control the motor to rotate thedisplay in a vertical direction; and control the display to display asecond content in the vertical direction, the second content beinggenerated by rotating the received transmission image data by 90degrees.
 2. The display device as claimed in claim 1, wherein theprocessor is configured to: based on receiving, from the user terminalthrough the communicator while the second content is displayed on thedisplay, transmission image data that correspond to a third content andhave a standard in the horizontal direction and information that thetransmission image data is generated by maintaining a rotation directionof the third content, control the motor to rotate the display in thehorizontal direction; and control the display to display the thirdcontent.
 3. The display device as claimed in claim 1, furthercomprising: a microphone, wherein the processor is further configured toreceive a user command for controlling the display device while thesecond content is displayed on the display; and wherein the user commandis obtained by inputting a user voice received through the microphonewhile the second content is displayed on the display to a trainedartificial intelligence model.
 4. The display device as claimed in claim1, wherein the processor is further configured to, based on acommunication connection with the user terminal being terminated whilethe second content is displayed on the display, control the motor torotate the display in the horizontal direction.
 5. A non-transitorycomputer-readable recording medium including a program for executing acontrolling method of a user terminal, the method comprising: receivinga user input for transmitting content corresponding to a screendisplayed on a display of the user terminal to a display deviceconnected to the user terminal; based on obtaining information that arotation direction of the user terminal is a vertical direction,generating transmission image data that is generated by rotating contentcorresponding to a screen displayed on the display in a horizontaldirection; and transmitting, to the display device, the transmissionimage data and information indicating that the transmission image datais generated by rotating the content in the horizontal direction.
 6. Thenon-transitory computer-readable recording medium as claimed in claim 5,wherein the transmission image data is transmitted to the display devicein a horizontal image standard, and wherein the generating thetransmission image data further comprises rotating the contentcorresponding to the screen that is displayed on the display by 90degrees to correspond to the horizontal image standard.
 7. Thenon-transitory computer-readable recording medium as claimed in claim 6,further comprising: based on obtaining information that a rotationdirection of the user terminal is the horizontal direction, generatingtransmission image data in which a direction of content corresponding toa screen displayed on the display is maintained; and transmitting thetransmission image data in which the direction of the contentcorresponding to the screen displayed on the display is maintained, tothe display device.
 8. The non-transitory computer-readable recordingmedium as claimed in claim 5, wherein the user input is received througha user interface displayed on the display.
 9. The non-transitorycomputer-readable recording medium as claimed in claim 5, wherein theuser input is received from the display device.
 10. A controlling methodof a user terminal, comprising: receiving a user input for transmittingcontent corresponding to a screen displayed on a display of the userterminal to a display device connected to the user terminal; based onobtaining information that a rotation direction of the user terminal isa vertical direction, generating transmission image data that isgenerated by rotating content corresponding to a screen displayed on thedisplay in a horizontal direction; and transmitting, to the displaydevice the transmission image data and information indicating that thetransmission image data is generated by rotating the content in thehorizontal direction.
 11. The method as claimed in claim 10, wherein thetransmission image data is transmitted to the display device in ahorizontal image standard, and wherein the generating the transmissionimage data further comprises rotating the content corresponding to thescreen displayed on the display by 90 degrees to correspond to thehorizontal image standard.
 12. The method as claimed in claim 11,further comprising: based on obtaining information that a rotationdirection of the user terminal is the horizontal direction, generatingtransmission image data in which a direction of content corresponding toa screen displayed on the display is maintained; and transmitting thetransmission image data in which the direction of the contentcorresponding to the screen displayed on the display is maintained, tothe display device.
 13. The method as claimed in claim 10, wherein theuser input is received through a user interface displayed on thedisplay.
 14. The method as claimed in claim 10, wherein the user inputis received from the display device.